Pontryagin's Minimum Principle-Guided RL for Minimum-Time Exploration of Spatiotemporal Fields.

This article studies the trajectory planning problem of an autonomous vehicle for exploring a spatiotemporal field subject to a constraint on cumulative information. Since the resulting problem depends on the signal strength distribution of the field, which is unknown in practice, we advocate the use of a model-free reinforcement learning (RL) method to find the solution. Given the vehicle's dynamical model, a critical (and open) question is how to judiciously merge the model-based optimality conditions into the model-free RL framework for improved efficiency and generalization, for which this work provides some positive results. Specifically, we discretize the continuous action space by leveraging analytic optimality conditions for the minimum-time optimization problem via Pontryagin's minimum principle (PMP). This allows us to develop a novel discrete PMP-based RL trajectory planning algorithm, which learns a planning policy faster than those based on a continuous action space. Simulation results: 1) validate the effectiveness of the PMP-based RL algorithm and 2) demonstrate its advantages, in terms of both learning efficiency and the vehicle's exploration time, over two baseline methods for continuous control inputs.

Sociodemographic determinants of intraurban variations in COVID-19 incidence: the case of Barcelona.

BACKGROUND: Intraurban sociodemographic risk factors for COVID-19 have yet to be fully understood. We investigated the relationship between COVID-19 incidence and sociodemographic factors in Barcelona at a fine-grained geography. METHODS: This cross-sectional ecological study is based on 10 550 confirmed cases of COVID-19 registered during the first wave in the municipality of Barcelona (population 1.64 million). We considered 16 variables on the demographic structure, urban density, household conditions, socioeconomic status, mobility and health characteristics for 76 geographical units of analysis (neighbourhoods), using a lasso analysis to identify the most relevant variables. We then fitted a multivariate Quasi-Poisson model that explained the COVID-19 incidence by neighbourhood in relation to these variables. RESULTS: Neighbourhoods with: (1) greater population density, (2) an aged population structure, (3) a high presence of nursing homes, (4) high proportions of individuals who left their residential area during lockdown and/or (5) working in health-related occupations were more likely to register a higher number of cases of COVID-19. Conversely, COVID-19 incidence was negatively associated with (6) percentage of residents with post-secondary education and (7) population born in countries with a high Human Development Index. CONCLUSION: Like other historical pandemics, the incidence of COVID-19 is associated with neighbourhood sociodemographic factors with a greater burden faced by already deprived areas. Because urban social and health injustices already existed in those geographical units with higher COVID-19 incidence in Barcelona, the current pandemic is likely to reinforce both health and social inequalities, and urban environmental injustice all together.

Data and Network Analytics for COVID-19 ICU Patients: A Case Study for a Spanish Hospital.

The COVID-19 pandemic presents unprecedented challenges to the healthcare systems around the world. In 2020, Spain was among the countries with the highest Intensive Care Unit (ICU) hospitalization and mortality rates. This work analyzes data of COVID-19 patients admitted to a Spanish ICU during the first wave of the pandemic. The patients in our study either died (deceased patients) or were discharged from the ICU (non-deceased patients) and underwent the following landmarks: beginning of symptoms; arrival at the emergency department; beginning of the hospital stay; and ICU admission. Our goal is to create a graph-based data-science methodology to find associations among patients' comorbidities, previous medication, symptoms, and the COVID-19 treatment, and to analyze their evolution across landmarks. Towards that end, we first perform a hypothesis test based on bootstrap to identify discriminative features among deceased and non-deceased patients. Then, we leverage graph-based representations and network analytics to determine pairwise associations and complex relations among clinical features. The descriptive statistical analysis confirms that deceased patients exhibit multiple comorbidities with stronger levels of association and are treated with a wider range of drugs during the ICU stay. We also observe that the most common treatment was the simultaneous administration of lopinavir/ritonavir with hydroxychloroquine, regardless of the patients' outcome. Our results illustrate how graph tools and representations yield insights on the relations among comorbidities, drug treatments, and patients' evolution. All in all, the approach puts forth a new data-analysis tool for clinicians that can be applied to analyze (post-COVID) symptom/patient evolution.